Accepted for publication in Theory and Practice of Logic Programming 



1 



Transformation- Based Bottom- Up Computation 
of the Well-Founded Model 



STEFAN BRASS 

School of Information Sciences, University of Pittsburgh, 
135 North Bellefield Ave., Pittsburgh, PA 15260, USA, 
e-mail: sbrass@sis.pitt.edu 

JURGEN DIX 

The University of Manchester, Dept. of Computer Science, 
Oxford Road, Manchester, M13 9PL, UK, 
email: jdix@cs.man.ac.uk 

BURKHARD FREITAG and ULRICH ZUKOWSKI 

Universitat Passau, Fakultat fur Mathematik und Informatik, 
D-94 030 Passau, Germany, 
email: freitag, zukowski@fmi.uni-passau.de 



Abstract 



We present a framework for expressing bottom-up algorithms to compute the well-founded 
model of non-disjunctive logic programs. Our method is based on the notion of co nditional 
facts and elementary program transformations studied by Brass and Dix in ( Brass 
Dix, 1994; Brass & Dix, 1999) for disjunctive programs. However, even if we restrict their 
framework to nondisjunctive programs, their "residual program" can grow to exponential 
size, whereas for function-free programs our "program remainder" is always polynomial 
in the size of the extensional database (EDB). 

We show that particular orderings of our transformations (we call them strategies) 
correspond to well - known computatio nal methods like the alternating fixpo int approach 



( Van Gelder, 1989 ; Van Gelder, 1993), the well-found ed magic sets me thod (Kemp et al., 
1995D and the magic alternating fixpoint pr ocedure ( Morishita, 1996). However, due to 
the confluence of our calculi (first noted in (Brass & Dix, 1998)), we come up with com- 
putations of the well-founded model that are provably better than these methods. 

In contrast to other approaches, our transformation method treats magic set trans- 
formed programs correctly, i.e. it always computes a relevant part of the well-founded 
model of the original program. 

These results show that our approach is a valuable tool to analyze, compare, and opti- 
mize existing evaluation methods or to create new strategies that are automatically proven 
to be correct if they can be described by a sequence of transformations in our framework. 
We have also developed a prototypical implementation. Experiments illustrate that the 
theoretical results carry over to the implemented prototype and may be used to optimize 
real life systems. 
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1 Introduction 



The next generation of deductive database systems (see Ramakrishnan's article 
in ( Apt et at, 1999 )) will probably support the full class of normal programs. It 



seems also very likely that the well-founded semantics will be chosen by many sys- 
tem designers, because it has a unique model. Furthermore, the time complexity of 
computing the well-founded model of a given intensional database (IDB) is poly- 



nomial in the size of the cxtcnsional database (EDB) ( Van Gelder et al., 1991 ). In 



contrast, it has been shown by Marek and Truszczynski ( [Marek fe Truszczyn 



ski, 1991) that even for a propositional logic program P, determining whether P 



has a stable model is NP-complete. Extensions of deductive database systems that 



can deal with the well-founded semantics are already realized in XSB ( Chen et al 



itag et al., 1991 



Freitag, 1997) 



1995; Chen & Warren, 1996; Bagonas et al, 1994) and announced for LOLA (Frc 



Zukowski & Freitag, 1996a; Zukowski fc Freitag, 1996q ; Zukowski 



The SLG-resolution of Chen and Warren (Chen et al, 1995; Chen & Warren, 



1996), as implemented in the XSB system, is the most prominent top-down method 



for the computation of the well-founded model of a normal program. In this paper 
we characterize "good" bottom-up methods in terms of elementary program trans- 
formations. Essentially, the bottom-up algorithms that compute the well-founded 
model of a normal program are: 



The alternating fixpoint approach, introduced by Van Gelder ( |Van Gelder 



1989| ; |Van Gelder, 1993) and further developed by Kemp, Stuckey and Sri- 



vastava (Kemp et al, 1995). Many other bottom- up methods (|Kemp et al 



1995| ; pVlorishita, 1996| ; ptuckey fc Sudarshan, 1997| ) are based on this ap 



proach. 

The computation of the residual program, as suggested by Bry (Bry, 1989 



Kan- 



Bry, 199C ) and independently by Dung/Kanchanasut ( |Dung fc 
chansut, 1989a; Dung fc Kanchansut, 1989b), and extended by Brass 



and Dix ( Brass fc Dix, 1999 ; Brass fc Dix, 1998 ) for disjunctive logic pro- 



grams. 

The alternating fixpoint procedure is known to have efficiency problems in the 
sense that it needs quadratic evaluation time for programs that could be easily 
computed in linear time w.r.t. their size. In every iteration many facts have to be 
recomputed. The residual program approach avoids recomputations of this kind, 
and thus needs only linear time for many programs the alternating fixpoint approach 
needs quadratic time for. But it is possible that the residual program can grow to 
exponential size while for function-free programs the alternating fixpoint approach 
guarantees a number of derived facts that is polynomial in the size, i.e. the number of 
tuples, of the extensional database (EDB). However, the residual program contains 
important information which is not provided by the alternating fixpoint method. 

It is natural to ask for an algorithm which combines the advantages of both 
bottom-up approaches. In this paper, we present a framework for the computation 
of the well-founded model that is based on the residual program method but guar- 
antees polynomial complexity like the alternating fixpoint procedure. The residual 
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program method is based on elementary program transformations and the concept 
of conditional facts. Conditional facts are ground rules having those negative literals 
in their bodies that can not (yet) be resolved because their complement is not (yet) 
known to be true or false. This can be regarded as a non-procedural equivalent of 
the delay operation needed in SLG-resolution ( phen et al, 199£ ; Chen & Warren 



1996). Like in SLG-Resolution, the key idea to avoid the exponential blow-up of the 



residual program is to delay not only negative literals but also positive literals which 
depend on delayed negative literals. The transformation-based program remainder 
method which we propose in this paper can be seen as a bottom-up equivalent of 
SLG-resolution for the case of range-restricted function-free programs. 

We also introduce the important notion of a regular strategy expression, which is 
used to define different evaluation methods in a simple and declarative way. Various 
such strategies are shown to correspond exactly to the alternating fixpoint compu- 
tation (( Van Gelder, 1989 ; Van Gelder, 1993 )), the well-founded magic sets method 
( Kemp et al., 1995 ) and the magic alternating fixpoint procedure ( Morishita, 1996| ). 

But our method is not applicable only to range-restricted programs. In many 
cases, the magic set transformed version of a non-range-restricted program w.r.t. a 
given query is range-restricted. Although it is known that the magic set transforma- 
tion (Bceri & Ramakrishnan, 1991) has problems in the context of the well-founded 
semantics our method treats magic set transformed programs correctly. Moreover, 
we show that our approach is guaranteed to need not more work than the well- 
founded magic sets method (Kemp et al., 1995) or the magic alternating fixpoint 
( Morishita, 1996] ) and is much more efficient for many programs. 

The rest of the paper is organized as follows. After introducing preliminaries in 
Section ||, we recall the alternating fixpoint procedure in Section ||. In Section [|, we 
introduce our program transformation approach for ground programs. In Section ^| 
we present a method that performs an intelligent grounding. Section ^ compares 
our approach to the alternating fixpoint procedure. Section ^ introduces a regular 
expression like syntax to express and compare different evaluation strategies. In 
Section || we extend our transformation approach to handle magic set transformed 
programs. Section [)] discusses our approach and compares it with related work. 
Section nCM concludes the paper. 



2 Preliminaries 

A rule is of the form A <— L\ A - • • AL n , where the head A is an atom and each body 
literal Li is a positive literal, i.e. an atom, or a negative literal Li = not B. We 
treat the rule body as a set of literals and write also A <— B with B = {Li, . . . , L n }. 
Consequently, a fact A is represented by the rule A <— 0. We also use the notation 
A <— B A not C with atom sets B and C. 

A program is a set of rules as introduced above. We consider normal, i.e., non- 
disjunctive, logic programs without function symbols. We assume that all rules are 
range-restricted, i.e. that each variable of the rule appears also in a positive body 
literal. The size of a program is the number of literal occurrences. 

Let P be a program. BASE(P) denotes the Herbrand base of P, i.e. the set of all 
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ground atoms which can be built using the predicates and constants occurring in P. 
It might happen that our transformations eliminate some constants and predicates 
from the program, but we use the Herbrand base BASE(P) of the original program. 
We write ground(P) for the Herbrand instantiation of a program P. For a ground 
program P we define the following sets: 

facts(P) := {A e BASE(P) \ (A <- 0) € P}, 

heads(P) := {A G BASE(P) | there is a 23 such that (A <- 23) € P}. 

The complement of a literal L is denoted by ~i, i.e., ~(-B) = not P and, conversely, 
^(notP) = P. For a set S 1 of literals, ~S denotes the set of the complements of 
the literals in S. S is consistent if and only if S(l = 0. For a set S of literals we 
define the following sets: 

pos(S) := {A e S | A is a positive literal }, 
nefii(S') := {A | not A e 5}. 

Let P be a logic program. A partial interpretation for P is a consistent set / of 
ground literals such that 

pos{I) U neg{I) C BASE{P), 

i.e., its set of atoms is a subset of the Herbrand base of P. A total interpretation 
for P is a partial interpretation / such that 

A e BASE(P) => A e I or not A e I, 

i.e., for each atom A of the Herbrand base of P either A or its complement is 
contained in I. Two partial interpretations are said to agree on an atom Q if they 
contain the same ground instances of Q and not Q. 

For an operator T we define T ] := and T f i := T(T ] i - 1), for i > 0. 
lfp(T) denotes the least fixpoint of T, i.e. the smallest set S such that T(S) = S. 
We rely on the definition of the well-founded partial model Wp of P as given in 



(Van Gelder et al, 1991). An operational characterization of Wp will be given 
in Section || Further, we assume familiarity with the concepts of the magic set 
transformation ( Beeri fc Ramakrishnan, 1991) ) . 



3 The Alternating Fixpoint Procedure 



Let us recall the definition of the alternating fixpoint procedure. We introduce an 
extended version of the immediate consequence operator that uses two different sets 
of facts for positive and negative subgoals, respectively. Actually, this is an adapta- 



tion of the stability transformation found in ( Van Gelder, 1989 ; Van Gelder, 1993 ) 



to our purposes. This operator has been introduced and investigated by Przy- 
MUSINSKI in (Przymusinski, 1989b; Przymusinski, 1990| ; Przymusinski, 1991). 



Definition 1 [Extended Immediate Consequence Operator) 

Let P be a normal logic program. Let I and J be sets of ground atoms. The set 
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Tp,j(I) of immediate consequences of I w.r.t. P and J is defined as follows: 

Tp,j(I) := {A | there is A <— B e ground(P) with pos(B) C I and 

neg{B) fl J = 0}. 

If P is definite, the set J is not needed and we obtain the standard immediate 
consequence operator Tp by Tp(7) = T P ^(I). 

T P> j checks negative subgoals against the set of possibly true atoms that is sup- 
plied as the argument J. This allows the following elegant formulation of the alter- 
nating fixpoint procedure. 

Definition 2 [Alternating Fixpoint Procedure) 

Let P be a normal logic program. Let P + denote the subprogram consisting of the 
definite rules of P. Then the sequence (Ki,UfJi>o with sets Ki of true (known) 
facts and [7j of possible (unknown) facts is defined by: 

K := lfp(T P+ ) U := lft>(2>,* ) 
i>0: Kt := lfpCTp^J, U t := tfp(T PtKi ). 

The computation terminates when the sequence becomes stationary, i.e., when a 
fixpoint is reached in the sense that 

(K j ,U j ) = (K j+u U j+1 ). 

This computation schema is called the Alternating Fixpoint Procedure (AFP). 

Theorem 3 {Correctness of AFP \Van Gelder, 199$ )) 

Let the sequence (Ki, Ui)i>o be defined as above. Then there is a j > such that 
(Kj, Uj) — (Kj+i, Uj+i). The well-founded model Wp of P can be directly derived 
from the fixpoint (Kj, Uj), i.e., 

Wp = {L | L is a positive ground literal and L £ Kj or 

L is a negative ground literal not A and A £ BASE(P) — Uj}. 

The following results which follow easily from the anti-monotonicity of Tp,j 
w.r.t. J are also stated in ( Kemp et ai, 1995 ). 

Lemma 4 (Monotonicity) 

Let the sequence (Ki, Ui)i>o be defined as above. Then the following holds for i > 0: 

KiQKi+i, UiDUi+x, KiCUi. 

Whereas the sets Ki of true facts can be computed incrementally, the sets f/j of 
possible facts have to be recomputed in every iteration step. It is well-known that 
this leads to many unnecessary recomputations even for simple programs. 

Example 5 (Quadratic Time Complexity of AFP) 

Consider the following logic program taken from ( Kemp et a/., 1995 ; Morishita. 
1996b 

p(X) <- t(X,Y, Z), not p(Y), not p(Z). 
p(X) 4- po(X). 
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and the following base facts: 

Po(ca), t(a, a, h), t(bi,ci,b 2 ), t(b 2 , c 2 , b 3 ), t(b n , c„, 6„+i). 

Due to the linear character of the graph of dependencies between the atoms p(b±) 
to p(b n ) we would expect that it is possible to compute the well-founded model of 
this program in linear time w.r.t. n. However, the alternating fixpoint procedure 
needs S iterations, each deriving a number of facts that is linear in n. So the 
total execution time is quadratic in n. Note that this effect becomes evident also 
for simpler programs, but we have chosen this program because it is interesting 
in the context of the magic set transformation and we can use the same example 
throughout the whole paper. 



4 Basic Ground Transformations 



Brass and Dix (Brass fc Dix, 1994; Brass k Dix, 1999; Brass fc Dix, 1997) have 



introduced a framework for studying and computing negation semantics by means 
of elementary program transformations. Based on this framework we introduce our 
transformation approach. 

Definition 6 [Program Transformation) 

A program transformation is a relation i— > between ground logic programs. 

The following two transformations reduce negative body literals if their truth value 
is obvious. These transformation are also used in ( Brass fc Dix, 1990| ) . 



Definition 7 [Positive Reduction) 

Let Pi and P 2 be ground programs. P 2 results from P\ by positive reduc- 
tion [Pi P 2 ) iff there is a rule A <— B in Pi and a negative lit- 
eral notP 6 B such that there is no rule about B in Pi, i.e., B ^ heads[Pi), 
and P 2 = (Pi - {A «- B}) U {A «- [B - {not 5})}. 

Definition 8 (Negative Reduction) 

Let Pi and P 2 be ground programs. P 2 results from Pi by negative reduction 
[Pi P2) iff there is a rule A <— B in Pi and a negative literal not B £ B such 

that B appears as a fact in Pi, i.e., B £ facts(Pi), and P 2 = Pi — {A <— £>}. 



In (Brass & Dix, 1999) positive body literals are resolved by unfolding. However, it 



is well-known that by unrestricted unfolding the resulting program can grow to a 



size that is exponential in the size of the original program (Chen & Warren, 1996 
[Zukowski et al, 1997 ). 



Example 9 (Exponential Residual Program) 
Consider the following program. 



KG)- 

p[X) <- p(Y),succ[Y,X), not q[Y). 

p(X) <- p(Y),succ(Y,X), not r(Y). 

q(X) <— succ(X, _), not q(X). 

r(X) <- succ(X,A, not r(X). 
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succ(0, 1). ... succ(n—l,n). 
The following diagram depicts all possible paths on which a p-fact can be derived: 



not<7(0) notg(l) 




p(0) p(l) p(2) 




notr(O) notr(l) 



By allowing unrestricted unfolding of all positive body literals we get the following 
program that is called residual program: 



p(0). 




p(l) * 


- notg(O). 


p(l) * 


- notr(O). 


p(2) * 


- not q(0), not <j(l) 


p(2) * 


- not q(0), not r(l) 


p(2) «- 


- not r(0), not q(l) 


p(2) * 


- notr(0),notr(l) 



It is obvious that every possible path is encoded in the residual program. Each 
possible fact p(n) is represented by 2" conditional facts. 

To achieve a polynomial complexity we introduce the following two transformations 
that are special cases of unfolding and reduce positive body literals only if their 
truth value is obvious. 

Definition 10 (Success) 

Let P\ and P2 be ground programs. Pi results from P\ by success (P\ 1— >g P2) iff 
there is a rule A <— B in Pi and a positive literal B <E B such that B £ facts(Pi), 
and P 2 = (Fx - {A<— B}) U {A <- (S - {£?})}. 

Definition 11 (Failure) 

Let Pi and P2 be ground programs. P2 results from Pi by failure (P\ t-^p P2) iff 
there is a rule A <— B in Pi and a positive literal B e B such that there is no rule 
about B in Pi, i.e., B £ heads(P 1 ), and P 2 = Pi - {A <- £}. 

Definition 12 

Let ^psnf be the rewriting system consisting of the above four transformations, 
i.e. ^>psnf := H pU ^jv U 1— >s U 1— >f- 
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This rewriting system is to be applied to a program as long as it is applicable, i.e., 
until a normal form w.r.t. these transformations is reached. 

Definition 13 {Normal Form) 

A program P' is a normal form of a program P w.r.t. a transformation i— > iff 
P i P' , and P' is irreducible, i.e. there is no program P" with P' \— > P". 

When a normal form P' is reached, the result of the transformation is interpreted 
in the following way: atoms appearing as facts in P' are true in P', atoms from 
the Her brand base of P not appearing in any rule head of P' are false in P', all 
remaining atoms are undefined in P'. 

Definition 11± (Known Literals) 

Let P be a ground program and let S be a set of ground atoms. The set of positive 
and negative ground literals with atoms in S having an obvious truth value in P is 
denoted by known s(P) : 

known $(P) '■= {L \ L 6 S is a positive ground literal 
and L G S n facts(P) or 
L is a negative ground literal not A 
and Ae S - heads(P)}. 

The next theorem states that the four transformations success, failure, positive 
and negative reduction correspond exactly to the Fitting operator $p, which is 



the procedural counterpart of the 3- valued completion compz (we refer to ( Fitting 
1985| ; |Dix, 1995a} pix, 1995b| ) for a detailed exposition of 4>p). 



Theorem 15 {^psnf corresponds to lfp($p)) 

The rewriting system ^psnf is confluent and strongly terminating. With strongly 
terminating, we mean that not only there exists a terminating sequence for a given 
program, but any rewriting sequence is terminating. It therefore induces a normal 
form fitt(P) for any program P. The known literals with respect to this normal 
form constitute exactly the least fixpoint lfp(<f>p) of Fitting's operator $p: 



lfp($p) = known base (P) {f itt( p )) ■ 



Proof 

See Appendix [X]. 



Note that for a given ground program P the normal form fitt(P) can be computed 
in a time linear in the size of P. An efficient algorithm based on the results of 



(Dowling & Gather, 1984) can be found in (Niemela & Simons, 1996). The four 
parts of this implementation, that reduce body literals, correspond directly to the 
four basic transformations defined above. Thus, that algorithm can be seen as an ef- 
ficient implementation of our rewriting system *—>-psnf- For many programs, e.g. for 
programs without positive loops, the Fitting operator computes the well-founded 
model. This positive effect of the Fitting operator has also been pointed out in 
(Bcrman et al., 1995; [Bubrahmanian et at, 19*95 ). However, positive loops have to 



be detected and removed separately. 
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Example 16 {Positive Loop) 
Consider the following program Loop: 

P- 

q <— not p. 

q <— r. 
r <— q. 

We can apply negative reduction to delete q «— notp, since notp is obviously false. 
But <—>-psNF does not allow to delete q <— r and r <— q. 

To remove positive loops we introduce the following transformation. 

Definition 17 (Loop Detection) 

Let Pi and P 2 be ground programs. Pi results from P\ by loop detection 
(Pi 1 — > l P2) iff there is a set A of ground atoms such that 

1. for each rule A <— B in Pi, if A G .A, then Bn^^0, 

2. P 2 := {A B G Pi I A <£ A}, 

3. Pi ^P 2 . 

In our earlier papers, we have defined loop detection such that all rules are deleted 
with a positive body atom in A. This has the disadvantage, however, that loop 
detection is not local to SCCs. For instance, in P — {p <— q, q <— p} U {r <— q}, 
the old version of loop detection would delete all three rules. But then the useful 
Lemma |lj would not hold. 

In contrast to the four transformations of <-^>psnf that can be applied locally, for 
loop detection we need a more global perspective on the program. The set A is 



the greatest unfounded set of Pi (w.r.t. the empty interpretation 0, cf. (Van Gelder 



et ah, 1991)). The greatest unfounded set consists of all positive ground atoms which 
are not possibly true, i.e., cannot be derived by assuming all negative literals to be 
true. According to Definition |l|, the extended immediate consequence operator Tp 1 $ 
computes the possibly true atoms. Therefore, the greatest unfounded set is given 
by BASE(P) — ]fp(T Pl $). This set has the property required for A in Definition |l7|: 



Lemma 18 (Loop Detection) 

Let Pi be a ground program and let 

P 2 = {(A^B)eP 1 I A g lf P (T Pl j)}. 

Then 

1. Pi ^ L P 2 (unless P 2 = Pi), and 

2. P 2 is irreducible w.r.t. 1— »x. 



Proof 

See Appendix [A]. 
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As shown in (Nicmela & Simons, 1996), the set lfp (T Pl 0) of possible atoms can 



be computed by the linear time algorithm of (Dowling & Gallier, 1984). As a con- 
sequence, also the operation of loop detection can be performed in time that is 
linear in the size of Pi. We compute lfp(T Pl j) and delete all rules A <— B with 
A # lfp(T Pl>0 ). 

Example 19 {Loop Detection) 

Consider again the program Loop of Example [l6| After deleting the second rule by 
negative reduction, loop detection can be applied using the unfounded set A = {q, r} 
to delete the third and fourth rule. 

Since more than one application of loop detection may be needed for some programs, 
in our final rewriting system we have to iterate all five transformations. 

Definition 20 

Let t-^x denote our final rewriting system: 

Thus 1 — >x can be seen as the extension of Fittings least fixpoint operator $p by 
loop detection (see Theorem |l5|) . A normal form w.r.t. the rewriting system 1— >x is 
called a program remainder: 

Definition 21 (Program Remainder) 

Let P be a program. Let the program P be a normal form of P w.r.t. t—*x- Then 
P is called a program remainder of P. 



Lemma 22 ( Termination) 

Every program P has a program remainder, i.e. the rewriting system 1— >x l& termi- 
nating. 

Proof 

All our transformations strictly reduce the total number of occurring literals. So if 
Pq := ground(P) and Pi is any program with Pj_i ^x Pi, i > 1> then we must 
reach a program P„ in which no further transformation can be applied. This is a 
program remainder of P. □ 



Theorem 23 (Computation of Weil-Founded Semantics) 

For every program P and remainder P, the well-founded model Wp of P satisfies 
exactly those positive and negative literals which are immediately obvious in P, i.e. 

W P = known BASE{P) (P). 

Proof 

See Appendix [a]. 

From this it is also simple to derive an explicit characterization of the program 
remainder: From the Herbrand instantiation of the program we obtain the program 
remainder by 
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1. deleting every rule instance with a body literal which is false in the well- 
founded model, and 

2. removing from the remaining rule instances the body literals which are true 
in the well-founded model. 



This is a kind of GELFOND/LiFSCHiTZ-transformation (Gelfond & Lifschitz, 1988). 



Theorem 24 (Unique Program Remainder) 

Let P be a remainder of a program P. The following holds: 

P = {A <- (B - Wp) | A <- B e ground(P) 

and for every B e B: ~B £ Wp}. 

Thus the remainder of a program is uniquely determined. In the following we will 
denote the program remainder of P by P. 

Proof 

See Appendix [X]. 



Corollory 25 (Confluence) 

The rewriting system i— >x is confluent, strongly terminating and the program re- 
mainder P is the unique normal form of ground(P) w.r.t. <-^x- 

Remember that, as a consequence of unlimited unfolding, the residual program, 



i.e. the normal form of the rewriting system of (Brass & Dix, 1999), can grow to 
a size that is exponential in the size of the original program. In our approach the 
program does not grow at all since all transformations strictly reduce the size of 
the program. 

Lemma 26 (Quadratic Time complexity) 

Let P be a ground program. Let n be the size of P, i.e., the number of occurrences 
of literals in P. Then P can be transformed into its remainder P in time 0(n 2 ). 

Proof 

As shown in ( Niemela fc Simons, 1996 ) the normal form of P w.r.t. <-^psnf can 
be computed in time 0(n). Also one application of loop detection can be performed 
in time 0(n). Since by each application of loop detection the size of the program 
is strictly reduced, loop detection can be applied at most n times. Altogether, the 
remainder P of P is reached in time 0(n 2 ). □ 

Note that quadratic time is needed in the worst case if loop detection is to be 
applied n times. Time complexity can be improved up to linear time, if the number 
of applications of loop detection can be reduced, depending on the dependencies in 
P. 



Example 27 (Linear Time Complexity) 
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Consider the following ground program 

p{a) «— not p(a), not p{b\). 
p(bi) <- notp(ci),notp(6 2 ). 
p(6 2 ) «- notp(c 2 ),notp(6 3 ). 

p(6„) «- notp(c„),notp(6„ + i). 

P{C2)- 

that results from instantiating the program from Example using the given base 
facts and removing obviously true body literals. Note that this grounding opera- 
tion can be done in linear time w.r.t. n. This program can be transformed by In 
applications of the transformations positive reduction or negative reduction into its 
remainder^: 

P(h). 

p(h)- p{b&). p(b 8 ). . . . p(b n ). 
P(c 2 ). 



5 Intelligent Grounding 

The transformations defined in Section are applicable only to ground programs 



(in (Dix & Stolzcnburg, 1998) it is shown how to lift our transformations to first- 
order disjunctive programs using constraints). To compute the well-founded model 
of a non-ground program P we could in a first step generate its Herbrand instan- 
tiation ground(P). However, this is a very costly operation since many irrelevant 
rule instances are produced. 

Example 28 {Complete Instantiation) 

Consider again the program from Example |^. Since it has about In constants and 
the first rule has three different variables, its Herbrand instantiation contains (2n) 3 
ground instances of the first rule. Thus the construction of the Herbrand instanti- 
ation would be more expensive than the model computation using the alternating 
fixpoint procedure (cf. Example ||). Instead we would like to construct a ground 



instantiation containing only relevant rule instances like that of Example 27 with 
only n ground instances of the first rule. 

In this section we show how for range-restricted programs a set of relevant ground 
rule instances can be derived efficiently. Together with the magic set transformation 
which we will discuss in Section |^, this technique can be applied to answer queries 
against programs that are not range-restricted. 

The key idea of the proposed grounding algorithm is to compute the set of all 
possible facts by ignoring all negative body literals during a bottom-up fixpoint 
iteration. This corresponds to the computation of the set Uq of possible atoms in 
the alternating fixpoint procedure (cf. Definition |^) . But when a rule instance is 



1 We assume that n is even. Otherwise the second line of the remainder changes slightly. 
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applied to derive a new atom, not only the head atom but the complete rule instance 
is stored. We call the ground instances derived this way conditional facts. 

Definition 29 {Conditional Fact) 

A conditional fact A <— C is a ground rule containing possibly both positive and 
negative delayed literals in the body. 

The following immediate consequence operator derives a new conditional fact if 
for each positive body literal of a ground rule instance there exists at least one 
matching conditional fact. 

Definition 30 {Immediate Consequences with Conditional Facts) 

Let P be a range-restricted normal program. Given a set S of conditional facts the 

operator Tp computes the following set of conditional facts: 

f P {S) := {A^B E ground(P) \ pos(B) C heads{S)} . 

Since Tp is monotonic, its least fixpoint lfp(Tp) exists. Obviously lfp(Tp) is 
a subset of ground{P). Because all our rules are range-restricted, the condition 
pos{B) C heads{S) binds all the variables and we never have to resort to a "blind 
instantiation". More precisely it is also clear that heads (lfp(Tp)J = lfp(Tpg). The 
operators are very similar, only Tp0 "forgets" the bodies of the applied rule in- 
stances. 

The following lemma embeds this kind of "intelligent grounding" into our 
transformation-based approach and shows that it can be seen as an efficient imple- 
mentation of a part our transformation system. 

Lemma 31 {Intelligent Grounding) 

Let P be a range-restricted normal program. Let Tp be defined as above, and let 
<-^lf '■= ^lUh Fi i.e. the combination of loop detection and failure. Then we have 

ground{P) Ifp(Tp). 

Proof 

See Appendix |^. 

From Lemma [H] it follows that lfp (Tp) can be used as a starting point for the 
transformation approach. 

Corollory 32 

Let P be a range-restricted normal program. Then lfp(Tp) ^>* x P holds. 
Example 33 {Grounding) 

Let P contain the rules and facts from Example B. Then lfp(Tp) contains 

p{a) <— t{a, a, bi), not p{a), not p{b±). 
p{bi) <- i(&i,ci,& 2 ), not p(ci), not p(b 2 ). 
p(b 2 ) <- t{b 2 ,c 2 ,b 3 ), not p{c 2 ), not p{b 3 ). 

p{b n ) <- t{b n ,c n ,b n+ i), not p{c n ), not p{b n+ i). 
p{c 2 ) <- Pa{c 2 ). 
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together with the base facts. 

The grounding algorithm can be made more efficient by evaluating a program 
P step by step according to the SCCs of its static dependency graph. Due to the 
confluence of our transformation system, we can transform the program P SCC by 
SCC. The following operator enables us to perform the grounding of P also SCC 



by SCC. These results are not surprising and we refer to (Zukowski et al, 1997) for 
more details. We will here present only the main result concerning the intelligent 
grounding. 

Definition 34 (Operator Tp,_r) 

Let P be a program and R be a ground program. Given a set S of conditional facts, 
the operator Tp,i? computes the following set of conditional facts: 

Tp, R {S) := {A <- B e ground(P) | pos(B) C heads(R) U heads(S) and 

neg{B) n facts(R) = 0}. 

If R is empty, we obtain the operator Tp of Definition [30] by Tp(S) = Tp^(S). 

Since this operator is monotonic, its least fixpoint exists. The following definition 
describes how it can be used for SCC-oriented program grounding and transforma- 
tion. 

Definition 35 (SCC-Oriented Evaluation) 

Let P be a program. Let PW , . . . , p(™ 1 ) be a partition of the set of rules of P such 
that no predicate occurring in PW occurs in the heads of for any 1 < i < j < m. 
Let the ground programs Rq, . . . , R m be defined as follows: 

• Ro ■= 0, 

• Ri is the program remainder of Ri^i U \fp(Tpa) for < i < m. 

The following theorem states that this evaluation scheme is correct and computes 
the remainder of P. 



Theorem 36 (SCC-Oriented Evaluation ( Zukowski et al., 1991( )) 



Let P be a program. Let the sequence Rq, . . . , R m be defined as above. Then R m 
is the remainder of P. 

Note that the bottom-up fixpoint computation of the grounding as described 
above performs an implicit loop detection for each SCC. As a consequence, for a 
large program class no explicit loop detection has to be applied. 



Lemma 37 (Avoiding Loop Detection (Zukowski et al., 1997)) 



Let P be a program. Let P contain no predicate which depends on itself both, 
positively and negatively (i.e. through negation). Then during the SCC-oriented 
grounding and transformation of P as defined in Definition [3f] no explicit application 
of loop detection is necessary. 

Further optimization can be obtained by immediately removing obviously true 
body literals from the conditional facts already during the fixpoint computation. 
This way normal (unconditional) facts are produced whenever the truth value of all 
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body literals is known whereas conditional facts are produced only if the predicate 
of a negative body literal is in the same SCC as the head predicate or a body literal 
depends already on a conditional fact. 

Example 38 {Optimized Grounding) 

Consider again the program from Example |5|. If during the grounding algorithm 
body literals that are known to be true are immediately removed, the simplified 



ground program from Example 27 is constructed, together with the base facts. Only 



literals with the recursive predicate p appear in conditions. 



Note that for predicate stratified programs flPrzymusinski, 1989a| ) the SCC 



oriented grounding with immediate removal of true body literals always computes 
the well-founded model of the program directly. Since the truth values of all nega- 
tive body literals are defined in lower SCCs, there is no need to produce any condi- 
tional facts. Thus the optimized grounding algorithm is a smooth generalization of 
the standard bottom-up fixpoint computation. Stratified parts of the program are 
evaluated as usual. Conditional facts are only generated for negative recursion. 



6 Relation to Alternating Fixpoint 

The computation of the set of all possibly true facts that is needed for the loop de- 



tection i — > l transformation (cf. Definition 17) is very similar to the computation of 



possible facts performed in each iteration step of the alternating fixpoint procedure 
(cf. Definition |^). There is an even closer correspondence as we will show in this 
section. 

Our main result is that a particular ordering of our transformations corresponds 
exactly to the alternating fixpoint procedure. To characterize the computation per- 
formed by the alternating fixpoint procedure we define a sequence (K-i, cfj)i>o where 
Ki and Ui are constructed by the program transformations defined in this paper 
and that is closely related to the sequence (Ki, Ui)i>Q computed by the alternating 
fixpoint procedure (cf . Definition ^) . 

Definition 39 {Alternating Fixpoint by Program Transformations) 

Let P be a normal logic program. We define the sequence (Ki,Ui)i>o of sets Ki 

and Ui of conditional facts as follows: 

Kq is the normal form of ground{P) w.r.t. <-^lfs, 
i.e., ground{P) ^* LF lfp(Tp) K , 

Uq is the normal form of Kq w.r.t. *—>nlf, 
i > : Ki is the normal form of ?7j_i w.r.t. i— >ps, 
i > : Ui is the normal form of Ki w.r.t. <—>nlf- 

The computation terminates when the sequence becomes stationary, i.e., when a 
fixpoint is reached in the sense that 

(K j ,U j ) = (K j+1 ,U j+1 ). 



Lemma 40 {Confluence of*->ps and *-^nlf) 
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In Definition [39], the normal form of Ui, i > 0, w.r.t. ^->ps and the normal form of 
Ki, % > 0, w.r.t. i — >nlf are uniquely determined. 

Proof 

See Appendix |(]. 
Remark 41 

Due to Corollary |25| and Lemma pl| the sequence Ui)i>o of Definition |39| reaches 
a fixpoint (.Kj, 0}) and computes the program remainder P = Kj = 

The computation of the sets K% of true facts by the alternating fixpoint procedure 
corresponds to the application of success and positive reduction on the transforma- 
tion side. The computation of the sets Ui of possible facts corresponds to deleting 
conditional facts by applying negative reduction, loop detection, and failure. The 
relation between the alternating fixpoint computation and the sequence of program 
transformations defined above is described more precisely by the following theorem. 



Theorem {Relation between AFP and Transformations) 

Let P be a normal logic program. Let (Ki, J7i)i>o and (Ki,Ui)i>o be the se- 
quences given by Definitions || and |39|, respectively. Then the following holds: 
Ki = facts(Ki) and Ui — heads(Ui). 

Proof 

See Appendix |^. 

Note that the last theorem states the correctness of the transformation method 
only for one specific strategy. Thus it does no restate Theorem which is more 
general and shows the correctness for any transformation strategy. 

Theorem ^ shows that the program transformation approach, if a transforma- 
tion strategy like that given in Definition ^9| is applied, will never do more work 
than the alternating fixpoint procedure. Although the number of conditional facts 
in the sets Ki and Ui may be greater than the number of unconditional facts in the 
corresponding sets Ki and Ui, the same number of computation steps is needed to 
derive them. The existence of several conditional facts having the same head shows 
that an atom can be derived by more than one rule application. Also the alternating 
fixpoint computation derives facts more than once, but performs a duplicate elim- 
ination afterwards. When a new fact is generated by the transformation approach 
by more than one transformation application to reduce all body literals of a rule 
instance, also the alternating fixpoint computation has to consider all body literals 
before the head of an rule instance can be derived. 

However, while having a (sometimes) better time complexity, the transformation 
approach is expected to have a space complexity worse than the alternating fixpoint 
approach. 



As proposed in (Kemp et al, 1995), the sets Ki do not have to be recomputed in 
each iteration step, but can be maintained in terms of increments. This optimization 
is automatically performed by the transformation approach, since conditional facts 



Transformation- Based Weil-Founded Model 



17 



that were transformed into facts by the deletion of their body literals are never 
changed afterwards. 

Note that the results of this section show that the alternating fixpoint procedure 
can be seen as one particular implementation of our approach (given by choosing 
a fixed ordering of applying the transformations). However, by choosing another 
ordering that delays the application of loop detection until no other transformation 
is applicable, the computation scheme will be much more efficient for many pro- 
grams. This has already been demonstrated in Examples || and ^7]. We will further 
illustrate this point in the next section. 

7 Regular Strategy Expressions 

In Section |^ we have seen that we can choose the evaluation strategy just by rear- 
ranging the order of transformation application. In order to specify a transformation 
order we introduce the following regular expression syntax. 

Definition 43 (Regular Strategy Expression) 

A regular strategy expression is defined inductively as follows: 

• The single letters P, S, N, F, and L are atomic regular strategy expressions. 

• If ei and ei are regular strategy expressions, then e\ei is a regular strategy 
expression. 

• If e is a regular strategy expression, then (e)* is a regular strategy expression. 

Let P be a ground program. Let e be a regular strategy expression. P is the result 
of the application of e to P, PiAP', if the following conditions hold: 

• If e is an atomic regular strategy expression, i.e., there is a ground transfor- 
mation > e , then P' is the normal form of P w.r.t. i— > e . 

• If e = eie2, then there exists a ground program P" such that PSp" and 
P"Sp' hold. 

• If e = (c)*, where c may be a complex, non- atomic strategy expression, then 
P' results from iteratively applying c to P until no changes occur. 

Lemma 44 (Unique Result) 

Let P be a ground program. Let e be a regular strategy expression. Then the result 
of applying e to P is uniquely determined, i.e., there is exactly one P' such that 
PAP' holds. 

Proof 

The proof is by induction over the structure of the regular strategy expression e and 
is based on the fact that the normal form of each base transformation is uniquely 
determined. □ 

If we compare strategies, we assume tacitly that the grounding algorithm of 
Section || is prepended such that the execution of the strategies always starts from 
the set of relevant ground rule instances. This is fair, since all bottom-up methods 
have to do the grounding operations, even if they are performed on the fly later 
during the computation. 
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Example 45 (Fitting Expression) 

Following Theorem |l5|, the least fixpoint of the Fitting operator corresponds to the 
normal form fitt(P) of the rewriting system >—>-psnf- Thus the computation of 
fitt(P) for a given program P can be expressed by the regular strategy expression 
(PSNF)* . Since a linear time algorithm for the Fitting operator applied to ground 



programs is given in (Niemela & Simons, 1996), for a ground program P the trans 



formation P i— * fitt(P) can be executed in time 0(n) where n is the size of P. 
Note that here the order of the four transformations has no influence on the time 
complexity. 

Example J^6 (AFP Expression) 

Following Definition |3?j and Theorem ^ one iteration of the alternating fixpoint 
procedure can be described by the expressions PS for the computation of Ki and 
NLF for the computation of {Zj. Thus, the model computation of the alternating 
fixpoint procedure can be described by the regular strategy expression (PS NLF)* . 
Since each application of the loop detection needs 0(n) time, the execution time of 

(P S N L F)* 

the transformation P \— » P is in 0(n 2 ) where n is the size of the given ground 
program P. Note that the expression PS is equivalent to the expression (PS)* , and 
NLF is equivalent to (NLF)*, i.e., the loop is always executed exactly once. This 
becomes evident in the proof of Lemma ^TJ. 

In the expression (PS NLF)* of Example [l6] the expensive loop detection is ap- 
plied in every iteration. In the following optimized strategy loop detection is removed 
from the inner loop and is only applied if no other transformation is applicable. 

Example ^7 (Optimized Remainder Expression) 

A more efficient strategy to compute the remainder of a given program is expressed 
by the regular strategy expression ((PSNF)*L)*. For programs without positive 

<(PSNF)*L)* 

loops, the transformation P i— » P can be executed in linear time, since the 
inner loop (PSNF)* computes the remainder and loop detection is not applicable. 
For programs with positive loops 0(n) iterations of the outer loop are necessary 
yielding again an execution time in 0(n 2 ) where n is size of the given ground 
program. 

Example 48 (Experimental Results) 

Consider the program shown in Example [s] and its ground instantiation from Ex- 
ample 27. Figure [l] illustrates execution times of the AFP strategy from Example 46 



and the optimized remainder strategy from Example 47 for different program sizes n 
ranging from 100 to 1000. The quadratic and linear character of the two strategies, 
respectively, is obvious. 

The tests have been run using our prototypical implementation in Java on a PC 
with an Intel Pentium III processor with 450 MHz and 256 MB of main memory, 
MS Windows NT 4.0 operating system and Sun JDK 1.3/3 java virtual machine. 
The same test running on a Sun Sparc Station with Sun Solaris operating system 
yields comparable results. 
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Fig. 1. Experimental Results 



8 Magic Transformation 



It is well-known that the magic set transformation ( Beeri fc Ramakrishnan, 1991 ) 



causes problems in the context of the well-founded semantics. For a given query 
the well-founded model of the magic set transformed program may not agree with 
the well-founded model of the original program on the query if magic facts get 
undefined truth values in the model of the transformed program. There are two 
prominent extensions of the alternating fixpoint procedure that solve this problem 
by considering undefined magic sets to be true at different steps of the computation. 
The first approach is the well-founded magic set method. 



Definition 49 {Well- Founded Magic Set (Kemp et al. ; 1995)) 

For a given normal program P, any sideways information passing (sip) strategy S, 



and a query Q, the well-founded magic set method (Kemp et al., 1995) determines 
the magic set transformed program MP — Magic(P, S, Q) of P w.r.t. S and Q. 
Then the set M of true or undefined magic facts in the well-founded model W^p is 
computed using the alternating fixpoint procedure. Finally the well-founded model 
of WFMagic(P, S, Q) := MP U M is computed, again using the alternating 
fixpoint procedure. 



We do not discuss the details of different sideways information passing strategies, 
since they are not relevant for our results, and assume that always standard left 



to right binding propagation is applied. For details we refer the reader to (Beeri 



Ramakrishnan, 1991; Kemp et al, 1995) 
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The correctness of the method described in Definition |49| is stated by the following 
theorem. 



Theorem 50 ( Well-Founded Magic Set \Kemp et al., 199$) ) 



Let P be a normal logic program. Let S be any sip strategy (cf. Definition |49|) . Let 
Q be a query. Let PM := WFMagic{P, S, Q). Then the well-founded models of 
PM and P agree on Q. 

To use this result in our approach we extend our transformation system by the 
following transformation that allows us to use undefined magic facts as if they were 
true. 

Definition 51 {Magic Reduction) 

Let P\ and Pi be ground programs. Pi results from P\ by magic reduction 
{Pi P2) iff there is a rule A <— B in Pi with head predicate p and 

a positive literal B E B with predicate magicjp such that B E heads{P\) and 
P2 = {Pi -{A^- 23}) U {A <- (23 - {£})}. ' 

Our final transformation system is defined as follows. 

Definition 52 {MX -Transformation) 

Let 1 — * mx denote the extended rewriting system: 

«MX := U i-Mf- 

Note that this new transformation system is not confluent any more! Depending 
on the application of the magic reduction transformation different strategies for 
handling undefined magic facts can be realized. However, the following theorem 
states that any strategy based on the MX-transformation computes the correct 
answer for the given query. 

Theorem 53 {Correctness of the MX -Transformation) 

Let P be a normal logic program. Let S be any sip strategy. Let Q be a query. 
Let MP = Magic{P, S, Q) be as defined above. Let P 1 be any normal form of MP 
w.r.t. h mx . Then the well-founded models of P' and P agree on Q. 

Proof 

This result is based on the fact that all magic facts that are undefined in the 
well-founded model if MP can be considered true by applications of the magic 
reduction transformation. In this case the correctness follows from Theorem But 
it can be the case that a conditional magic fact gets deleted before all conditions 
consisting of its head have been removed by applications of magic reduction. In this 
case the magic fact has become false because at least one of the body literals in 
each of its conditional facts have become false. But then also the rule instance for 
that the magic fact had been generated can be deleted, because its body contains 
all literals that the magic fact depends on, due the definition of the magic set 
transformation. Thus, the deleted magic fact is not needed to answer the given 
query. As a consequence, all magic facts needed to answer the given query are not 
deleted and can be considered to be true by applications of the magic reduction 
transformation. □ 
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We now extend our regular strategy expression syntax by the new transformation. 
Definition 54 (Regular Strategy Expression (cont.)) 

We extend Definition [l3] in the following way. The single letter M is also an atomic 
regular strategy expression. 



According to Definition 43, the expression M denotes the computation of the normal 
form w.r.t. i— vjvf, i.e. the removal of all true or undefined magic filters from rules 
with heads with non-magic predicates. This allows us to embed the well-founded 
magic set method as a special case of our transformation method. 

Definition 55 ( Well-Founded Magic Sets Strategy) 

The well-founded magic sets regular strategy expression is defined by 
(PSNLF)*M(PSNLF)*. 

Lemma 56 

Let MP be a magic set transformed ground program. The execution of the regular 
strategy expression (PSN LF)* M(PSN LF)* applied to MP corresponds to the 
computation of the well-founded magic sets method of Definition [49| . 

Proof 

This result follows from Theorem fl2L Example and Definitions [si] |54]. □ 

ft is obvious that the well-founded magic set strategy can be optimized by delaying 
the loop detection transformation. 

Definition 57 ( W ell-Founded Remainder) 

The well-founded remainder regular strategy expression is defined by 
((PSNF)*L)*M((PSNF)*L)*. 

Lemma 58 

Let MP be a magic set transformed ground program. The execution of the regular 
strategy expression ((P S N F)* L)* M ((P S N F)* L)* applied to MP is guaranteed 
to need no more work than the transformation-based computation described by the 
expression (PSN LF)* M(PSN LF)* . Furthermore, it is more efficient for many 
programs. 

Proof 

This statement follows directly from Theorem [l2| □ 

One disadvantage of the two strategies in Lemma ^ is that the application of 
the magic reduction transformation all undefined magic facts are considered to be 
true and removed from all bodies of non-magic rules. This can cause unnecessary 
computations since as a consequence of making some magic facts true it can happen 
that other magic facts become false, i.e., the computation of the corresponding 
subquery is not needed to answer the query. This is the motivation for another 
approach. The magic alternating fixpoint method uses a modified version of the 
alternating fixpoint procedure where in every computation of true facts all magic 
facts that were undefined in the preceding computation of true or possible facts are 
considered true. 
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Definition 59 (Magic Alternating Fixpoint ( Morishita, 199dp ) 



Let P be a normal logic program. Let S be any sip strategy (cf. Definition 49). Let 
Q be a query. Let MP = Magic(P, S, Q) be the magic transformed program of P 
w.r.t. S and Q. Let MP + denote the subprogram consisting of the definite rules of 
MP. The magic alternating fixpoint procedure computes the sequence (Ki, £7j)j>o 
defined as follows: 



i > 
i > 



K 

K, 

Ui 



lf P( T MP+) 

\fp(T M p,K„) 

^P(TMPijmagic_heads(Ui-i),Ui- 
lfp(T M p,Ki)- 



where magic Jieads(Ui-i) denotes the set of magic atoms in E7j_i. 
The correctness of this method is stated by the following theorem. 



Theorem 60 (Magic Alternating Fixpoint ( Morishita, 199L )) 

Let P be a normal logic program. Let S be any sip strategy (cf. Definition fl9|). Let Q 
be a query. Let the sequence (Ki, Ui)i>o be defined as above. Then the computation 
gets stationary, i.e., there is an j such that Kj — Kj+i and Uj = Uj+i. Furthermore, 
the corresponding interpretation I = KjU ^(BASE(P) — Uj) and the well-founded 
model Wp of P agree on Q. 

This approach dynamically changes the set of true magic atoms. The advantage of 
this method is stated by the following theorem. 



Theorem 61 (Comparison (Kemp et al., 1991; Morishita, 199t)) 
Let P be a normal logic program. Let Q be a query. The magic alternating fixpoint 
procedure is guaranteed to terminate after no more iterations than the well-founded 
magic sets approach, and the set of magic facts in the final set Uj of the magic 
alternating fixpoint procedure is a subset of the set M of true or undefined magic 
sets in the well-founded magic sets approach. 



In the magic alternating fixpoint procedure (Morishita, 1996) undefined magic facts 
are considered to be true only if this enables the derivation of new facts. This can 
be described by a special case of our magic reduction transformation. The restricted 
magic reduction transformation allows to remove a magic filter with undefined truth 
value from a non-magic rule only if it is the only body literal, i.e., the application 
transforms the rule into a fact. 

Definition 62 (Restricted Magic Reduction) 

from P\ by restricted magic reduction (Pi i— vjj P%) iff there is a rule A <— {B} in 
Pi with head predicate p such that the predicate of B is magicjp, B G heads(Pi) 
and P 2 = (Pi - {A <- B}) U {A}. 

It is easy to see that this restricted magic reduction transformation is sufficient to 
evaluate magic set transformed programs. 



Lemma 63 (Correctness of Restricted MX- Transformation) 
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Let MP be a magic set transformed ground program. Let P' a normal form of MP 
w.r.t. the rewriting system i— >x Uh^jj. Let P" be a normal form of P' w.r.t. <—>mx- 
Then known base{p)(P') = known base (p)(P") holds. 

Proof 

The only transformation applicable to P' can be <—>-m but without producing new 
facts. Thus no other transformation will become applicable, no new facts can be 
produced, and no rules can be deleted from P'. □ 

The following definition allows us to use the restricted magic reduction transforma- 
tion in regular strategy expressions. 

Definition 64 (Regular Strategy Expression (cont.J) 

We extend the Definitions [l3] and ^4] in the following way. The single letter R is 
also an atomic regular strategy expression. 

Now we can express the magic alternating fixpoint procedure as a special case of 
our rewriting system ^mx- 

Definition 65 (Magic Alternating Fixpoint Strategy) 

The Magic Alternating Fixpoint regular strategy expression is defined by 
(P(SR)*NLF)*. 



Lemma 66 

Let MP be a magic set transformed ground program. The execution of the regular 
strategy expression (P(SR)*NLF)* applied to MP corresponds to the computation 
of the magic alternating fixpoint procedure of Definition |59| . 

Proof 

The magic alternating fixpoint method modifies the alternating fixpoint procedure 
such that during the computation of true atoms undefined magic filters are con- 
sidered to be true. This means that we have to replace the expression S in the 
description of the alternating fixpoint procedure by the expression (SR)* that also 
computes the normal form of the success transformation but additionally is allowed 
to remove undefined magic filters from non-magic rules if this leads directly to the 
derivation of facts. □ 



Remark 67 (Monotonicity) 

Note that the sequence of sets Ki of true facts is not monotonically increasing in the 
magic alternating fixpoint procedure, because some magic facts and facts depend- 
ing on them that have been considered true once may possibly not be recomputed 
in a later iteration step. However, in the magic alternating fixpoint transformation, 
magic conditional facts may be deleted, but non-magic facts once derived as uncon- 
ditional facts are never deleted afterwards. Thus, our transformational counterpart 
of the magic alternating fixpoint procedure has the monotonicity property that is 
missing in the original approach of Morishita (Morishita, 1996). 
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Examining the magic alternating fixpoint strategy expression ((P(S R)* N LF)* 
there are two possible optimizations. The more obvious optimization is to delay 
the application of loop detection. The second optimization concerns the time when 
undefined magic facts are to be considered true. In ( Kemp et al., I995| ) it is argued 



that using magic facts too early may cause unnecessary computations since the 
magic undefined magic facts may become false later. Therefore we delay also the 
application of the restricted magic reduction in the following strategy. 

Definition 68 (Magic Remainder) 

The Magic Remainder regular strategy expression is defined by (((P S N F)* R)* L)* . 
Lemma 69 

Let MP be a magic set transformed ground program. The execution of the regular 
strategy expression ((P S N F)* R)* L)* applied to MP is guaranteed to need no 
more work than the transformation-based computation described by the expression 
(P(SR) * NLF)* and is more efficient for many programs. 

Proof 

The expression ((PSNF)*R)* can be executed in linear time w.r.t. the given ground 
program. For the expression (PSNF)* this has been discussed before. For the 
restricted magic reduction each rule has to be checked at most once, i.e., if all body 
literals except the magic filter have been removed. This operation adds extra costs 
that are also linear in the size of MP. The only expensive operation is the loop 
detection transformation which is removed from the inner loop and is applied only 
if no other transformation is applicable. An example for a program that is evaluated 
more efficiently by the transformation approach is shown in Example fn]. □ 

The following proposition is the main result of this section. 

Proposition 70 (Magic Remainder vs. Well-Founded Magic Sets) 
The computation corresponding to the magic remainder strategy is guaranteed to 
need no more work than the computation performed by the well-founded magic sets 
method or the magic alternating fixpoint and is more efficient for many programs. 

Proof 

This result follows directly from the Lemmata 56, p8l p6l and 69. □ 



The statement of this proposition is illustrated by the following example. 
Example 71 

Consider the following program MP 

p(X) «- m_p(X),t(X,Y, Z), not p(Y), not p(Z). 

p(X) <- m_p(X), Po (X). 

mjp(a). 

m_p(Y) <- m_p(X),t(X,Y,Z). 

m_p(Z) <- m_p(X),t(X,Y,Z),p(Y). 
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that results from the program P from Example || by the magic set transformation 
for the query p(a) together with the base facts 

p (c^),t(a,a,b),t(b 1 ,cx,b2),t(b2,C2,b 3 ), . . . , t(b n , c„, b n+1 ). 

Figure || illustrates the execution times of the four strategies of Definitions 55 
(WF-MST), (WF-Rem), || (M-AFP) and |e| (M-Rem) for different program 
sizes n. It can be seen that the WF-MST strategy makes all magic facts true and 
needs quadratic time to compute the complete well-founded model of the original 
program. The M-AFP strategy uses only the relevant magic facts and computes 
only the facts from p(b\) to p{b^) : but also needs quadratic time. The strategies 
WF-Rem and M-Rem compute the result in linear time, since the program does not 
contain positive loops and thus the loop detection is not needed. Consider now the 
same program but with an additional rule p(X) <— p(X). Now every p-fact depends 
positively on itself and a linear number of applications of loop detection is needed 
to compute the result. Figure || illustrates the execution times of the four strategies 
for the modified program. It can be seen that the execution times of the strategies 
M-AFP and M-Rem coincide and are less than the execution times of the strategies 
WF-MST and WF-Rem, which also coincide. The delay of the loop detection has 
no effect for this program. 
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9 Discussion 



Residual Program Approach 

The concept of conditional facts and the transformation of ground programshavc 



been introduced and investigated in (Brass & Dix, 1994; Brass & Dix, 1997; Brass 



Dix, 199S ; Brass fc Dix, 1999| ). Disjunctive ground programs are transformed into 



the so called residual program from which several semantics can be derived. Whereas 
the transformations positive and negative reduction are defined as in our approach, 
they allow full unfolding instead of only the special cases success and failure. As 
a consequence, the residual program can grow to a size that is exponential in the 
size of the original program. As a replacement for their unfolding and deletion of 
tautologies transformations we introduced the loop detection to remove positive 
loops. This way, the size of the program is reduced in every transformation step 
yielding a linear space complexity w.r.t. the size of the original program. 



Alternating Fixpoint Procedure 

We have presented a precise comparison to the alternating fixpoint procedure 
(Van Gelder, 1993) in Section^. In Theorem^ we showed that one specific ordering 
of our transformations corresponds exactly to the computation of the alternating 
fixpoint procedure. We proposed an evaluation strategy that is guaranteed to need 
no more work than the alternating fixpoint procedure but that needs linear time 
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to compute the model of many programs the alternating fixpoint approach needs 
quadratic time for. 

The key idea for this improvement is to avoid the repeated computations of pos- 
sible facts of the alternating fixpoint procedure. Instead, our grounding algorithm 
derives conditional facts, i.e., ground rule instances, that can be reduced efficiently. 
The expensive loop detection transformation is applied only if necessary. Of course, 
this improvement of the time complexity results in a possibly increased space com- 
plexity. 

It is well known that the alternating fixpoint procedure needs quadratic time 
even for programs without positive loops, e.g., if there is a sequence of negative 
dependencies between ground atoms as in Example |[ In Lemma |3?] we showed 
that our approach, in combination with SCC-oriented grounding, needs to apply 
loop detection only if any predicate occurring in a positive loop depends negatively 
on itself. For all other programs the well-founded model can be computed in lin- 
ear time w.r.t. the size of the generated ground programs by applying the four 
base transformations corresponding to the Fitting operator (cf. Theorem |l5| and 
Example ||). 



smodels 

The optimized alternating fixpoint strategy of Example ^ corresponds exactly to 



the well-founded model computation of the smodels approach (Niemela, & Simons, 



1996). The grounding algorithm of smodels also derives relevant ground instances of 



the given program rules, i.e., it generates conditional facts. In (Niemela & Simons 



1996) a linear-time algorithm for the Fitting operator is described that corresponds 
exactly to the computation of the normal form w.r.t. our <-^psnf transformation. 
In ( Niemela fc Simons, 1996| ) also a linear-time algorithm for the loop detection 



based on the evaluation method for propositional programs of ( Dowling fc Gallier, 



1984 ) is presented which we could adapt to our purposes. Thus the well-founded 
model computation of smodels can be considered as an efficient implementation of 
a specific strategy of our approach. However, it is not goal-directed and applicable 
only to range-restricted programs. As opposed to smodels, our approach is applica- 
ble to magic set transformed programs and thus allows a goal-directed evaluation 
of a large class of non range-restricted programs. 



Magic Set Transformation 



The alternating fixpoint procedure has been extended to magic set transformed 



programs (Beeri & Ramakrishnan, 1991) by several researchers. The well-founded 
magic sets methods (Kemp et al, 1995) and the magic alternating fixpoint procedure 
( [Morishita, 1996| ) treat magic set transformed programs by considering undefined 
magic facts to be true at different stages of the computation. The well-founded 



ordered search algorithm (Stuckey & Sudarshan, 1997) is an extension of the ordered 



search method (Ramakrishnan et ai, 1992), that applies the alternating fixpoint 
procedure whenever a negative cyclic dependency is detected. 
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We have shown in Lemmata |56| and ^36| that the first two methods are instances 
of our transformation approach. We proposed evaluation strategies (cf. Definitions 
and ^8|) that combined the correct treatment of magic set transformed programs 
with the efficient reduction of conditional facts of the smodels approach. Thus we 
presented an algorithm that combines the advantages of several methods, i.e. the 
goal-directed and set-oriented bottom-up computation without the unnecessary re- 
computations of possible facts. 

The well-founded ordered search method is not an instance of our transformation 
framework since it relies on a more complex bottom-up computation that keeps 
track of all dependencies between ground atoms. However, when a negative cyclic 
dependency if detected, an algorithm based on the alternating fixpoint us used to 
resolve them. At this point, our more efficient remainder computation based on 
conditional facts instead of simple atoms may be applied to improve the overall 
performance of the well-founded ordered search method. 



SLG 

The most prominent top-down methods for the computation of the well-founded 



semantics are the tabulated resolution of Bol and Degerstedt (Bol & Degerstedt 



1998) and the SLG resolution (Chen & Warren, 1996). Our approach is closely 



related to the SLG resolution, i.e., the transformation system i— >x can be seen as 
a bottom-up variant of the SLG resolution restricted to the model computation of 
ground programs. Together with the magic set transformation and the intelligent 
grounding algorithm, our approach allows also query answering against some non 
range-restricted programs. Thus for some applications, it may serve as an appro- 
priate bottom-up counterpart of the top-down SLG resolution. 

One major advantage of the SLG resolution is that the activation of subgoals and 
the instantiation of rules can be interleaved with the reduction of true or false body 
literals. SLG tries to evaluate completely one subgoal before the next body literal 
of a rule is activated. If one subgoal fails, the evaluation of the corresponding rule is 
terminated and the remaining subgoals are not instantiated. In our approach, each 
SCC has to be grounded completely before the transformation is applied to reduce 
true or false body literals. 

On the other hand, if large base relations are supplied, e.g. by external databases, 
a set-oriented evaluation is desired instead of a tuple-at-a-time strategy. For the 



SLG resolution an alternative scheduling strategy has been implemented (Freire 



et al., 1997) that realizes a breadth- first set-at-a-time tabling strategy that has 
been proven to be iteration-equivalent to a form of semi-naive magic evaluation. 
We propose the evaluation in two phases, a bottom-up computation using optimized 
relational techniques, followed by a reduction phase for the case that any condi- 
tional facts have been derived. Our approach supports a set-oriented evaluation and 
allows mixed top-down and bottom-up strategies. As we have verified in our proto- 
type implementation, it is straightforward to extend the classical relational algebra 



operations and the differential fixpoint iteration (Balbin & Ramamohanarao, 1986) 



to generate conditional facts in the presence of negative body literals. 
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Another advantage of our transformation system is its simplicity. Most com- 
putation methods for the well-founded semantics (except the alternating fixpoint 
procedure) need sophisticated data structures or algorithms already to guarantee 
a correct evaluation. Our approach is easy to understand, thus appropriate for ed- 
ucational purposes, and easy to implement, as we have shown by our prototypical 
implementation. Different optimizations can be applied, and of course have to be 
applied in order to get a competitive real life system, but these optimizations are 
not predetermined by the method. Furthermore, extensions to the transformation 
system, e.g. to compute a variant of the well-founded semantics, are straightforward. 



10 Conclusion 



We have presented an algorithm for computing the well-founded semantics of 
function-free programs which is based on the set of elementary program transfor- 



mations studied by Brass and Dix ([Brass fc Dix, 1994 [Brass k, Dix, 1997| ; [Brass 



Dix, 1998 ; Brass fc Dix, 1999 ). The execution time of our algorithm is polynomial 
in the size of the EDB. If all positive body literals in the program remainder were 
replaced (and tautologies were deleted), we would get the residual program plus 
some non-minimal conditional facts. So the program remainder can be seen as an 
efficient encoding of the residual program. It is equivalent to the original program 
under a wide range of semantics. In fact, our rewriting system i— >x is even weaker 
than the transformations used in ( Brass fc Dix, 1994 ; Brass fc Dix, 1999|) because 
full unfolding is not needed to compute the program remainder. 

We have shown the flexibility of our method by introducing regular strategy ex- 
pressions. In particular, we have presented strategies corresponding to the com- 
putation of the least fixpoint of the Fitting operator, to the alternating fixpoint 



approach ( Van Gelder, 1989 ; Van Gelder, 1993 ), to the well-founded magic sets 
approach of ( Kemp et ai, 1995 ) and to the magic alternating fixpoint approach of 
( Morishita, 1996 ). By using the confluence of our calculi or choosing better strate- 
gies, we are never doing more work than these methods: as shown by experimental 
results, there are many examples where our method is superior. 

In fact our approach also extends to magic sets methods and avoids the recom- 
putations of many facts. 

We have shown that many bottom-up computation methods that are based on the 
alternating fixpoint procedure can profit directly from our results. Using conditional 



facts in the well-founded magic set method (Kemp et ai, 1995), the magic alter- 
nating fixp oint procedure ([Vlorishita, 1996] ), and the well-founded ordered search 
algorithm (Btuckey & Sudarshan, 1997), unnecessary computations can be avoided 
in all three approaches. The combination of the goal-directed search strategy of or- 
dered search together with our concepts of conditional facts to store and later reduce 
possible facts yields a method that may be a competitive bottom-up counterpart 



of the top-down method SLG (Chen & Warren, 1996) 
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A Proofs of Section ^ 

Definition 72 (Allowed Transformation) 

A semantics S allows a transformation i— > iff S(P\) = S(P2) for all Pi and Pi with 
Pi >-> P 2 - 

Definition 73 (Deletion of Tautologies) 

Let Pi and P2 be ground programs. Program P2 results from program Pi by deletion 
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of tautologies (Pi P2) iff there is A <— B G Pi such that A e B and 

P 2 = Pi - {A «- B}. 

Definition 74 ( Unfolding) 

Let Pi and P2 be ground programs. Program Pi results from program Pi by un- 
folding (Pi t-^u P 2 ) iff there is a rule A <— B in Pi and a positive literal JJeB 
such that 

P 2 = (Pi -{A^B}) U {A <— ((B - {B}) U B') I B <- B' £ P}. 
Definition 75 (Deletion of Non-minimal Rules) 

Let Pi and P 2 be ground programs. Program P 2 results from the program Pi by 
deletion of non-minimal rules (Pi P2) iff there are rules A <— B and A <— B' 

in Pi such that B C B' and P 2 = Pi - {A <- B'}. 

Lemma 76 

If a semantics 5 allows unfolding and the deletion of non-minimal rules, then it 
also allows success. 

Proof 

Success corresponds to unfolding, when the program contains a fact B <— and B 
is replaced by 0. However, there might be further rules about B besides this fact. 
But then the resulting rules are certainly non-minimal, so we can remove them 

with 1— >m- n 

Lemma 77 

If a semantics S allows unfolding, then it also allows failure. 
Proof 

Obviously, the transformation i—tp is a very special case of unfolding, i.e., if there 
are no rules about the unfolded literal. □ 

Lemma 78 

Let S be a semantics which allows unfolding, deletion of non-minimal rules, and 
positive and negative reduction. Then also 

P ^PSNF P 2 =>■ S(Pl) = S(P 2 ) 

for all ground programs Pi and P 2 . 
Proof 

The lemma follows immediately from the Lemmata |76| and [7^. □ 
Proof 

of Theorem Strong termination is obvious, because all transformations strictly 
reduce the number of literals occurring in the transformed program. To show con- 
fluence, we first note that success commutes with the other three transformations: 



If P h s ft, and Pi ^tr P' then P ^> tr Pi P' 
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and 



IfP ^ tr Pi, and Pi ^ s P' then P ^ s P 2 ^ tr P' 
for tr e {F,N,P}. 

To show confluence, it suffices (using general results about confluent systems) to 
prove: if P Pi and P ^* PNF Pi then there is P' such that Pi ^>* P N F P' 

and P2 ^* PN F P', for X 6 {P, A/', P}. This follows immediately by checking that 
the following diagrams commute: 



P 



P' 



A" 



AT 



P' 



P' 



The diagrams commute for the following reason: the condition for the application of 
one of the transformations P, N, or F is the existence of a fact or the non-existence 
of a head atom. By all our transformations no facts can be deleted and no rules 
with new heads can be generated. Thus, if a transformation is applicable to a rule, 
it will stay applicable if other transformations are applied first. 

It remains to show the relation to Fitting's least fixpoint of $p. This operator 
can be best explained if we view it as a mapping between 3- valued interpretations. 
If we denote the set of truth values by 3 fc , then $ P : 3 k Bp 1 — * 3 fe Bp ; 1 1 — > $p(I) 
is defined as follows: (A is a ground atom) 



t, if there is a clause A <— L\, . . . , L n in P with: 

— Vi < n we have: 

- I(Li) = t. 

f, if for all clauses A <— L\, 

— 3i < n with: 

- T(Li) = f. 
u, otherwise. 



$ P (1)(A) = { 



, L n G P we have: 



We will identify lfp(<I>p) with a three- valued model resp. with a set of literals. 
Starting from the empty three- valued interpretation, where all atoms are undefined, 
true and false atoms are added by applying <J>p until a fixpoint is reached. 

To determine the exact relationship between the iterations of $p and the appli- 
cations of our transformations, we define 



stepi(P) := normal form of P after applying 



and 



P N 



stepi + i(P) :— normal form of stepi(P) after applying 1— F and 
Obviously (by inspection of the definition of <3?p) we have the following result: 
$ P f = knowriBASE^istcp^P)). 
Clearly, $p reaches a fixpoint if and only if the program P is irreducible with 
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respect to i— >J F PN . The computation of lfp($p) therefore corresponds to a specific 
ordering of our transformations. □ 

Proof 

of Lemma [7^. 

1. First we have to show that A = BASE(P) — ]fp(T Pl $) satisfies the first 
requirement in Definition namely that for every rule A <— B in Pi, if 
A € A, then B D A ^ 0. Suppose that this was not the case. Then P x would 
contain a rule A^~ B with pos(B) C lfp(T Pl $) and ^4 ^ lfp(Pp 1: 0). But this is 
impossible, since if pos(B) is already derived by T Pl @, then A will be derived 
in the next step. Thus, loop detection can indeed be applied with this set A, 
and we get 

P 2 = {(A^B)eP 1 | AeMTp.fi)}- 

2. The second part is to show that P 2 is irreducible w.r.t. i— Suppose that loop 
detection is applicable to Pi based on some set A' of ground atoms. Because 
of the second and third conditions in Definition [l7], an atom from A' must 
appear in at least on rule head of P 2 . By the construction of P 2 , this atom 
is contained in lfp(Tp 0). But this is impossible: We show by induction on i 
that A' fl (T Pl f i) = 0. For i = this is trivial. Let now A <— 23 be applied in 
the «-th iteration. By the induction hypothesis, we know that pos(B) DA' = 
and thus B f)A' = 0. Since A 6 (Tp^a T *)> the rme is a l so contained in P 2 . 
But then the first condition in Definition [l7| implies that A A'. 

□ 

The following lemma shows that loop detection is a special case of deletion of 
tautologies and unfolding. 

Lemma 79 

If Pi i— P 2l then also Pl h^* t(/ P 2 . Thus any semantics 5, which allows unfolding 
and deletion of tautologies, also allows /oop detection. 

Proof 

Let yl be a set of ground atoms such that for all rules A <— B in Pi, if A G A, 
then S n A ^ 0. Let P 2 := {A <- 23 G Pi \ A £ A}. We will show that Pi - P 2 , 
i.e. the rules with an atom from A in the head, can be deleted by unfolding and 
elimination of tautologies, by induction on the number n of atoms from A, which 
actually appear in rule bodies of Pi — P 2 . If n = 0, no atom of A appears in a body 
of a rule from P\—P 2 . But since each of the deleted rules must have such an atom in 
the body, this means Pi = P 2 , and thus Pi i— >* TU P 2 trivially holds. Let now n > 
and Aq £ Abe an atom which appears in at least one body of a rule from Pi — P 2 . 
In a first step we eliminate from Pi all tautological rules containing Aq in head and 
body. These rules are contained in Pi — P 2 , so we are allowed to remove them. In 
the second step, we unfold all remaining occurrences of Aq in bodies of rules which 
also contain an atom from A in their head. Let the resulting program be called P[. 
Then we have the following: 
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• In P[, Aq does not appear in any rule body with an atom from A in the 
head. Since we have eliminated the tautologies first, the rules generated by 
the unfolding do not contain Aq in their bodies. 

• The number of atoms from A that appear in rules in P[ with head in A is at 
most n — 1. 

• The rules which were deleted by the unfolding steps contain an element of A 
in the head, so they are contained in P± — P 2 . The rules which were generated 
by the unfolding step also contain an atom from A in the head (since the 
head is not changed by unfolding). Thus, P 2 = {A <— B G P[ \ A £ A}. 

The induction hypothesis then gives P[ ^*tu P2, and thus together we have 
Pi »*tu p i ^*tu p 2- □ 

Theorem 80 [Equivalence of Program Remainder) 

Let S be any semantics which allows unfolding, deletion of tautologies, positive and 
negative reduction, and the deletion of non-minimal rules. Then 

S{P) = S{P) 

for every program P with remainder P. 

Proof 

This follows immediately from the Lemmata |78| and [79|. □ 
Proof 

of Theorem |^|. Since the well-founded semantics allows the transformations re- 
quired to apply Theorem |o[ P and P have the same well-founded model, i.e., 
Wp = WX. Thus it suffices to show that W~ = known base(P){P)- We do this by 
executing the alternating fixpoint procedure on P. 

1. Kq = facts(P): It is clear that at least these facts are contained in Kq, 
i.e. facts(P) C Kq. To show equality assume that Kq — facts(P) ^ 0. Let 
A <— Li A • • • A L n be the first rule with non-empty body applied by the 
alternating fixpoint procedure. By Definition |^ the Li are all positive and 
contained in facts(P). But then the success transformation is applicable to 
P. This contradicts the irreducibility of P. 

2. Uq = heads(P): The inclusion Uq C heads(P) is trivial. Now assume that 
Uq C heads(P) holds. Let A := BASE{P) - Uq and let A <- B be an 
arbitrary rule of P with A G A (such a rule exists because Uq ^ heads(P)). 
If B (~l A =/= 0, loop detection were applicable, contradicting the irreducibility 
of P. Thus we have Bf\A=%, and therefore pos(B) C Uq. But then, since 
A G A, i.e., A ^ Uq, there must be a negative literal not B G B with B G Kq. 
In this case negative reduction would be applicable to P which is impossible 
because P is irreducible. 

3. K\ = facts(P): The inclusion facts(P) C K\ is trivial, because the fixpoint 
K\ :— lfp(Tp v ) (cf. Definition ||) of course contains all facts of P. To show 

equality assume that K\ — facts(P) ^ 0. Let A <— L\ A • • • A L n G P be 
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the first rule with non-empty body applied during the computation of K\. 
If it contains a positive body literal Li, Li £ facts(P) must hold. But then, 
success is applicable, contradicting the irreducibility of P. If it contains a 
negative body literal L\ = notf?, B ^ Uq = heads(P) must hold. But then, 
positive reduction is applicable, contradicting again the irreducibility of P. 
4. Since Ki = K , we also have Ui = Uq, so the fixpoint is reached. 

□ 

Proof 

of Theorem Q Let us temporarily call the transformation on the right hand 
side wred, i.e. for any program P' let 

wred{P') := {A <- {B - Wp,) \ A <- B G ground(P') 

and for every B G B: ~B £ Wp,}. 

1. We first show that 

fi P-x => wred(Pi) = wred(P 2 ). 

(a) Pi i — t p P2: Positive reduction removes a negative body literal noti? from 
some rule A <— B, if B £ heads(Pi). Positive reduction does not change 
the well-founded model. Furthermore not B is certainly true in the well- 
founded model. Thus B - W Pl = (B - {notB}) - W* Pr 

(b) Pi 1 — ► _/y Pi: Negative reduction deletes a rule A <— B where B contains a 
negative literal noti3 such that B G facts(Pi). But then B is true in the 
well-founded model of P\ and P2, so the wred-transformation will delete 
this rule anyway. 

(c) Pi i-^s Pi'. Success removes a positive body literal B from some rule 
A <— B, if B G facts(Pi). Success does not change the well-founded 
model, and furthermore B is certainly true in this well-founded model. 
Thus we can conclude B - W Pl = (B — {B}) - Wp 2 . 

(d) Pi P2: Failure deletes a rule A <— B where B contains a positive 
literal B such that B ^ heads(Pi). But then notB is true in the well- 
founded model of Pi and P2, so the wrerf-transformation will delete this 
rule anyway. 

(e) Pi 1— »x Pi'- Loop detection w.r.t. to an unfounded set A deletes all rules 
A <— B where A E A. By the first condition of Definition [l7], this also 
means that B contains a positive body literal B with Be A But since all 
atoms in the unfounded set A are false in the well-founded model of Pi 
and P2, the wred-transformation will delete these rules anyway. 

2. Since ground(P) 1— >* x P, we have wred(ground(P)) = wred(P). Because the 

well-founded semantics is instantiation-invariant the definition of wred implies 

wred(P) = wred(P). We now only have to show wred(P) = P. Assume that 

wred(P) P. Then there is a rule A <— B G P such that there is B G B and 

either A <— B has been modified by wred because B G WX or entirely deleted 

because ~£? G W2~. But we know by Theorem G3l that 
P i_j 

Wp = known base(p){P)- 
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We can distinguish the following four cases: 

(a) B S WX. 

v i P 

i B is positive. It follows that B G facts(P). But then success is appli- 
cable, contradicting the irreducibility of P. 

ii B = not C is negative. It follows that C <fc heads(P). But then positive 
reduction is applicable, again contradicting the irreducibility of P. 

(b) ~B € 

i B is positive. It follows that not B £ W~ and thus B ^ heads (P). But 
then failure is applicable, contradicting the irreducibility of P. 

ii _B = not C is negative. It follows that C G WX and thus C G facts(P). 
But then negative reduction is applicable, again contradicting the ir- 
reducibility of P. 



B Proofs of Section |5] 

Proof 

of Lemma HJ. Following Lemma Q .4 := BASE(P) — lfp(Tpj) is a valid reference 
set for loop detection. Let P' be the result of applying loop detection w.r.t. this set 
A to ground(P). It follows that 

P' = {A <-8e ground(P) \ A G lfp(T P0 )}. 

Thus heads(P') C lfp(T P 0), and we can use failure to remove also the rules which 
contain a positive body literal B with i? g' lfp(T p0 ). Then the result is 

P" = {A<-Be ground(P) \ {A} U pos(B) C lfp(T p0 )}. 

As mentioned above, it is obvious that lfp(T P0 ) = heads(lfp(Tp)). To prove 
P" = lfp(Tp), we show that P" C Ifp(T P ) and P" D lfp(T P ): 

1. It is clear that i^Be ground(P) with 

pos(23) C lfp(T P0 ) = freads(lfp(T P )), 

thus A <— B must also be contained in lfp(T P ). 

2. If A B G ground(P) is derived by T P , this means that 

pos(B) C heads(]£p(f P )) = lfp(T P>0 ) 
and A G headsQ£p(T P )) = lfp(T p0 ). 

□ 



Proof 



C Proofs of Section ^| 
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of Lemma To begin with, we recall Lemma and observe that Kq is well- 
defined. The proof by induction is based on the following reasoning: 

1. As one possible application of <-^ps never interferes with another possible 
application of >-^ps, the transformations i— >p and i— ><j can be applied in any 
order and always produce the same result. In particular, it is legal to apply 
all possible transformations first, followed by all possible ^ s transfor- 
mations, because i— >s does not derive any new negative information, i.e., it 
does not delete any rule instance. 

2. Analogously, to construct the normal form w.r.t. ^nlf it is legal to apply all 
possible i — ► TV transformations first before applying i— >lf, since loop detection 
and failure do not derive any new facts, i.e., they only delete rule instances. 
All applicable i— > n transformations can be applied in any order because they 
do not interfere with each other and together always delete the same set of 
rule instances. Since the greatest unfounded set of a program is the union 
of all unfounded sets, the normal form w.r.t. i— >l can be constructed by one 
application of >^ L w.r.t. this greatest unfounded set (cf. Lemma |l8|) . Finally, 
rule instances with positive body literals known to be false are deleted by 
applying i— If for an atom A all rule instances having A as their head atom 
can be deleted by t— >p then {^4} is an unfounded set and the corresponding 
rules have already been deleted by i— Thus all possible applications of t— >p 
can be performed in any order. 

□ 

Lemma 81 

Let Pi be any ground program and let P2 be the normal form of Pi w.r.t. 1— >s 
(success). Then: 

P2 = {A<— (B - facts(P 2 )) A notC \ A ^ B f\ notC € Pi}. 

Proof 

Every rule in P2 results from a rule of Pi by removing positive body literals. Only 
positive body literals can be removed which are known as facts, and the set of 
facts can only increase during this process. Since P2 is irreducible w.r.t. <—>s, atoms 
in factsiP^) cannot occur any longer as positive body literals. □ 

Lemma 82 

Let Pi be any ground program and let P2 be the normal form of Pi w.r.t. 1 — s-tv 
(negative reduction). Then: 

P2 = {A <- B A notC e Pi I C n facts(Pi) = 0}. 

Proof 

Negative reduction deletes the rules which have a negative body literal con- 
flicting with a fact. The set of facts is not changed during this process, 
i.e. facts(P 1 ) = facts(P 2 ). □ 
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Lemma 83 

Let Pi be any ground program and let P 2 be the normal form of P\ w.r.t. t-^p 
(positive reduction). Then: 

P 2 = {A<—B f\ not(C (~l heads(Pi)) \ A ^ B A notC £ Pi}. 

Proof 

Positive reduction removes the negative body literals for which the corresponding 
positive atom does not appear as a head literal. The set of head literals is not 
changed during this process, i.e. heads(Pi) — heads(P<i). □ 

Lemma 84 

Let Pi be any ground program and let Pi be the normal form of Pi w.r.t. ^lf 
(loop detection and failure). Then: P 2 = lfp(Tpi)- 

Proof 

1. Pi ^* LF lfp (Ppi) has already been proven in Lemma |3l]. 

2. We show that lfp(Tp 1 ) is irreducible w.r.t. >-*lf- Let us assume that 1— »x is 
applicable. Let A be as in the definition of 1— >x (Definition [l?]). Consider the 
first iteration of the fixpoint iteration in which a rule instance A <— B A not C 
is derived with B O A 7^ 0. There must be such a rule instance since loop 
detection would not be applicable otherwise. Let B £ B P\ A. Then a rule 
instance P <— B' A not C has been derived in a previous iteration. This means 
that B'nA — 0. But this contradicts the first condition in Definition p"7| which 
implies that 1— »x is not applicable to lfp (Tp t ). Now let us assume that 1 — > is 
applicable. Then there is a rule instance A <— B A not C and an atom B £ 23 
that is not contained in heads (lfp (Tpj )). But this contradicts the iterative 
construction of lfp (Tp^. 

□ 

Lemma 85 

Let Pi be any ground program and let P 2 be the normal form of Pi w.r.t. 
(loop detection and failure). Then: 

P 2 = {A <- B A notC £ Pi I B C /Ws(P 2 )}. 

Proof 

This follows immediately from Lemma |84|: Since P 2 is a fixpoint of Tpi > every 
rule A <— B A notC £ Pi with B C heads(P2) must be contained in P 2 . On 
the other hand, it follows from the iterative construction of lfp(Tp 1 ) that any rule 
A <— £> A notC contained in lfp (Tpj) must satisfy i3 C heads(]£p(Tp 1 )). □ 

Proo/ 

0/ Theorem [JJ. We do not only show facts(Ki) = and heads(Ui) = Pi but also 
the following stronger characterizations of K. L and Uf. 

K = (B-K Q ) AnotC | 

A^BA not C £ ground(P), B C lfp(T P)0 )} 
P = {^4^ (S-ifo) AnotC | 

^ <- B A notC £ ground(P), B<ZU , CD K = 0} 
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Ki = {A <- (B - Ki) A not(C n Z7<_i) | 

A <- B A notC € ground(P), B C C n =0}, i > 

E7i = {A <- (B - Ki) A not(C n C/Ui) | 

A <- B A notC G ground(P), B C C n X* = 0}, i > 0. 
The proof is by induction on i. 

1. Proof for Kq: Due to Lemma [H] we already know that 
ground(P) hp(Tp). It is easy to show by induction on the num- 

ber of derivation steps that 

lfp(fp) = {A <- B A notC | A <- 6 A not C G ground(P), B C T P . } 



(because heads(Tp f j) = Tp f j). By Definition 39 i^o results from lfp(Tp) 
by applying h- >g until irreducibility w.r.t. i— >s- We show that facts(Ko) = Kq: 

(a) i^o C facts(Ko): We show T P + | j C facts(Ko) by induction on j: 
The case j = is trivial since T P + f = 0. Now suppose that A 
has been derived in step j by applying A <— B G ground{P + ). Then 
B C Tp+ f (j — 1) and therefore B C facts(Ko) by the induction hypoth- 
esis. Furthermore we know that Tp+ f (j — 1) C lfp(Tp+) C lfp(Tp ) and 
therefore A ^ B G lfp(Tp). But since B C facts(Ko) and -Ko is the 
normal form of lfp(Tp) w.r.t. t— it follows that A G facts(Ko). 

(b) facts(Ko) C i^ : The proof is by induction on the number of applications 
of i — All facts contained in lfp(Tp) are also contained in ground(P + ) 
and thus in Kq. Suppose that A is derived from the rule A <— B G hp (Tp) 
by j applications of h^ s . Then the atoms in B are derived in fewer steps, 
and thus B C K by the induction hypothesis. Since Kq is a fixpoint 
of T P + and A ^ B E ground(P + ) it follows that A G Kq. 



The characterization of 1£q now follows from facts(Ko) — Kq by Lemma 81 
and the introductory remark on lfp (Tp). 
. Proof for Uq: To construct Uo from Kq we may compute the normal form 
of Kq w.r.t. i — ► _/y first (see proof of Lemma which we denote by Nq in the 
following. By Lemma ^ and the characterization of Kq already shown above 

Nq= {A^- (B-Kq) A notC | 

A^BA not C G ground(P), B C lfp(Tp ), C n if = 0} 

holds. Let E/o be the normal form of iVo w.r.t. i — >£p. We show that 
heads(Uo) = Uq: 

(a) Uq C heads(Uo): Because we have ?7o = lfp(Tp,A" )i we prove 
Tp,K T j ' C heads{Uo) by induction on j. The case j = is trivial. 
Let now A G Tpx T J have been derived by using the rule instance 
A «- 23 A notC. Then B C Tp Xo T (j - 1) and C n if = 0. Also 
TpK T (j - 1)_C lfp(TpK ) C lfp(Tp ), thus A ^ (B-Kq)A notC 
is contained in Nq. By the induction hypothesis, we have B C heads(Uo). 
By Lemma |5| this implies that A <— (B — i£o) A notC is not deleted by 
loop detection or failure. Thus A G heads(Uo) . 

(b) heads(Uo) C f/ : By Lemma |84|, £?o = lfp(TjY n ). Therefore, we show 
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heads(Tfj f j) C U by induction on j. The case j = is trivial again. 
Now suppose that A <— (B — ifo) A not C has been derived in step j. Then 
(B -K )C heads{T No | (j - 1)) and therefore (B - if ) C [7 by the in- 
duction hypothesis. But C [To also holds by Lemma |], thus B C Uq. We 
also have C (~l Kq = 0, otherwise the rule instance would not be contained 
in No. But since Uq = ltp(Tp,K ), it follows that A 6 Uq. 

Our characterization of Uo follows from heads(Uo) — Uo by Lemma |85|. 
. Proof for Ki, i > 1: To construct Ki, we first apply positive reduction to 
until irreducibility w.r.t. >— >p and denote the resulting set by iVj. By the 

induction hypothesis we have heads(Ui-i) — E/j_i and 

E/i-i = {A^(fl-tf i _i)Anot(CnE/' i _a) | 

A^BA not C G ground(P), B C [/,_!, Cnif,_i = 0}. 

By Lemma |83| and since E/j_i C C/ i _ 2 (Lemma [|) it follows that 

N i = {A<-(B- Ki-{) A not(C n Ui-x) \ 

A <- 6 A notC £ ground{P), B C [/*_!, Cnif f -i = 0} 

holds. Now we apply i— >g until irreducibility w.r.t. i— >s, the result is We 
show that facts(Ki) — K^. 

(a) facts(Ki) C i^: The proof is by induction on the number of applica- 
tions of *—>s- Let A G facts(Ki). Either A G facbs{Ki—\) and the main 
induction hypothesis gives A G -fQ-i C Ki or A results from a rule 

A <— (B - Ki_ t ) A not(C n 

in TV, where C n t/,_i = and B — can be derived as facts with fewer 
applications of Then the induction hypothesis gives (B — -fQ-i) C ATj. 
Furthermore C .fQ by Lemma |]. Thus B C Ki. But then the rule 

instance A <— B A notC is applicable in the computation of lfpfTpt/^) 
and we get A £ Ki. 

(b) JsTi C facts(Ki): Because of the equality Ki = ^(Tpt^.j), we show 
(Tp t u i _ 1 T i) facts(Ki) by induction on j: The case j = is trivial. 
Now suppose that A has been derived in step j by applying A <— BAnot C. 
Then SC (Tp iC/i _ 1 | (j - 1)) andCnC/,-1 =0. The first part gives us 
B C A"; which together with Lemma [| implies B C X, C [/, C f/i-i. 
C (~l J7j_i = implies, again using Lemma I, that CnA',_i = l. Together 
we can conclude that 

A «- (B - Ki-t) A not(C n Ui-i) 

is contained in N. Moreover, C n f/i-i = shows that there are actu- 
ally no negative body literals, so the rule applied is A <— (B — ^Q-i)- 
B C (Tp y u i _ 1 | (j — 1)) together with the induction hypothesis gives us 
B C facts(Ki). But since Ai is irreducible w.r.t. i— >s, and A <— (B — -Kj-i) 
is contained in iVj, we can finally conclude i 6 ifj. 

Our characterization now follows from facts(Ki) — Ki by Lemma |8l] and 

Lemma | C Ki). 
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4. Proof for Ui, i > 1: To construct Ui from K, we first compute the normal 
form of Ki w.r.t. i— >n which we denote by iVj. By Lemma ^2] 

Ni = {A <- 6 A notC £ Ki \ Cnfacts(KA = 0}. 

As we have just seen, the induction hypothesis implies the characterization of 
Ki and facts(Ki) = Ki. Therefore and since C Ki (see Lemma [|) we 

can conclude that 

N = {A<-(B- Ki) A not(C n Ui- X ) \ 

A^B A notC G ground(P), B QUi-i, C n K = 9} 

holds. Let Ui be the normal form of Ni w.r.t. i— *i,p. We show heads(Ui) = Ui. 

(a) heads{Ui) C By Lemma f7, = Ifp(Tjy- ). Therefore, we show 
heads(Tft. If) C f/j by induction on j. The case j = is trivial. Now 
suppose that 

A ^ (B — Ki) A not(C n l/<_i) 
has been derived in step j. Then (B — i<Q) C heads(Tjy. \ (j — 1)) and 
therefore (B — Ki) C by the induction hypothesis. But i<Q C Ui also 
holds by Lemma|, and thus B C[/j. We also have Cni^ = 0, otherwise the 
derived ground rule would not be contained in Ni. But [/j = lfp (Tp^), 
and we can apply A <— £> A notC in the computation of Up (Tpj^), so 
A G Ui. 

(b) [/, C heads(Ui): Since [/j = lfp(Tp.x ; ), we prove 

(Tp.Ki T j) Q heads{Ui) 

by induction on j. The case j = is trivial. Let now A G (Tp t K t T i) 
be derived by applying the rule instance A <— B A notC 
Then B C (Tp,^ T (j - 1)) and C n K = 0. Since 
T P , Ki T (j - 1) C \£p(T PtKi ) = Ui and U t C C/i_i by Lemma g, we get 
S C C/j_i. Therefore, the ground rule 

A<— (B — Ki) A not(C n E/j_i) 

is contained in JV,. From 2? C [Tp^ T ~~ 1)) the induction hypothesis 
gives usSC heads(Ui). But then A G heads(Ui) follows from Lemma 

Our characterization of Ui follows from heads(Ui) = Ui by Lemma |8^ and 
Lemma ^ (Ui C ?7j_i). 

□ 



